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Letter to the Editor 

We are concerned that statisticians, such as Biedermann 
et al. [1], advocate the position that data may not be 
needed to support assumptions 'as long as probability is 
properly considered as an expression of personal belief. 
At a time when the National Academy of Sciences [2] 
has urged the need for the forensic science community 
to provide reliable results based on 'objective' data, 
these authors' position cannot be reconciled. The Report 
noted (on its page 8), 'The simple reality is that the 
interpretation of forensic evidence is not always based 
on scientific studies to determine its validity ... A body 
of research is required to establish the limits and mea- 
sures of performance and to address the impact of 
sources of variability and potential bias. Such research is 
sorely needed, but it seems to be lacking in most of the 
forensic disciplines that rely on subjective assessments 
of matching characteristics. These disciplines need to 
develop rigorous protocols to guide these subjective 
interpretations and pursue equally rigorous research and 
evaluation programs'. It is this approach that distin- 
guishes science from other epistemologies. Then the 
Report called for research in its Recommendation 3 
(page 23), 'Research is needed to address issues of accu- 
racy, reliability, and validity in the forensic science disci- 
plines ... [and in section c of Recommendation 3] the 
development of quantifiable measures of uncertainty in 
the conclusions of forensic analyses'. 

Foremost, none should abide the inclusion of over- 
stated evidence in reports or legal proceedings as it can 
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impinge on the presumption of innocence. The tenet of 
this presumption should be held dearly by all, and we as 
scientists should strive to reduce practices that cannot 
be supported. Biedermann et al. [1] appear to argue 
that, because there is 'subjectivity in science', one does 
not necessarily have to be held to a standard of justify- 
ing assumptions. It is well accepted that there is subjec- 
tivity in science. Indeed, Budowle et al. [3] and others 
(see references in [3]) have discussed the inherent sub- 
jectivity that exists. It may never be possible to remove 
all subjectivity, and for that reason we should attempt to 
develop and agree upon guidelines (or rules) about 
methods to minimize faulty generalizations. The asser- 
tion of Biedermann et al. [1] that we do 'not require 
new guidelines edited by the forensic DNA community' 
is a formula for continued misapplication. Scientists 
endeavor to identify the subjectivities and the conse- 
quences that might shape or misdirect our conclusions. 
Our use of the term objectivity [4] is clear in context. 
Data should support the prior probabilities that are 
employed. In this regard, we maintain our position. 

Budowle et al. [4] described the Collins case [5], 
which held that the courts are concerned about the 
assumptions made by scientists being justified with 
actual data that support them. Oddly, Biedermann et al. 
stated 'it remains questionable whether scientists should 
interfere with a topic of which practicing legal decision 
makers are already well aware and that, above all, they 
are in a better position to appreciate' and cite the case 
State of New Jersey versus Spann [6]. Biedermann et al. 
have misunderstood the decisions in the Spann and Col- 
lins cases. These cases fully support our call for an 
empirical basis for assumptions and that untethered use 
of personal belief is not acceptable. The court is calling 
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for more justification and guidance and that scientists 
not usurp the responsibility of the jury. Courts typically 
do not prescribe science to scientists; they demand that 
the scientists support their conclusions with data. Perso- 
nal beliefs alone are not a sufficient basis for entering 
scientific evidence into legal proceedings. However, in 
contrast to the misunderstandings of Biedermann et al., 
the Courts in Collins and Spann have prescribed what is 
not scientifically acceptable. 

Contrary to the position promoted by Biedermann et 
al. [1], we advocate that conclusions by scientists be 
supported with data. For too long the human identity 
community has avoided addressing the issue of generat- 
ing prior probabilities in missing persons identification 
cases. Indeed, in a number of cases, inflated values have 
been proffered. We reiterate that none of us should 
abide overstated evidence being presented in legal pro- 
ceedings or being placed in reports. Our position 
remains that guidelines are needed so that the triers of 
fact can use better informed judgment. At the least the 
legal community can be better educated on the pitfalls 
wherein scientists may become trapped to ensure the 
presumption of innocence is protected and justice is 
served. 

It is worth noting that Jackson et al. [7], of which one 
of the authors is prominently cited by Biedermann et al. 
[1] to support their opinion in their letter, opined that 
'This information and knowledge may provide a valid, 
robust assessment of the priors but there is a risk of the 
scientist being swayed by unreliable or limited prior 
information, from witnesses for example, towards an 
erroneous high prior for one hypothesis' and 'We 
believe that any expression of posterior probabilities, 
without making clear the priors, and the information on 
which the priors were based, runs a serious risk of pro- 
viding misleading opinion'. Perhaps Biedermann et al. 
missed these concerns when reviewing the literature. 
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